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A "baUistic-search" algorithm is presented which allows 
the identification of clusters (or funnels) of ground states in 
Ising spin glasses even for moderate system sizes. The clusters 
are defined to be sets of states, which are connected in state- 
space by chains of zero-energy flips of spins. The technique 
can also be used to estimate the sizes of such clusters. The 
performance of the method is tested with respect to different 
system sizes and choices of parameters. As an application 
the ground-state funnel structure of two-dimensional ± J spin 
glasses of systems up to size L = 20 is analyzed by calculating 
a huge number of ground states per realization. A T = 
entropy per spin of so = 0.086(4)fcs is obtained. 

Keywords (PACS-codes): Spin glasses and other 
random models (75.10.Nr), Numerical simulation studies 
(75.40.Mg), General mathematical systems (02.10.Jf). 



I. INTRODUCTION 

The calculation of the energetic minima of spin glass 
systems Q remains the paradigm for difficult optimiza- 
tion problems in physics. Usually, only one of the states 
exhibiting the lowest energy is calculated, even if a sys- 
tem is characterized by many minima having all the same 
lowest energy. In |^ an algorithm is presented, which 
allows to analyze large numbers of ground states and en- 
ables to identify all ground-state funnels of Ising spin 
glass systems efficiently. Moreover, it is possible to ana- 
lyze all funnels without having all ground states available. 
In this work the algorithm is presented in detail. Since 
the algorithm has a random nature, one has to show that 
the method is in fact reliable. This will be the main part 
of this paper. 

The algorithm is applicable to Edwards-Anderson 
(EA) ± J spin glasses. They consist of N spins ai = ±1, 
described by the Hamiltonian 



H 



(1) 



The sum runs over all pairs of neighbors. The spins 
are placed on a d-dimensional lattice of linear size L with 
periodic boundary conditions in all directions. Systems 
with quenched disorder of the interactions (bonds) are 
considered. Their possible values are = ±1 with equal 



probability. To reduce the fluctuations, a constraint is 
imposed, so that j) Jij — 0- Since the Hamiltonian 
exhibits no external field, reversing all spins of a configu- 
ration (also called state) z = {ci} results in a state with 
the same energy, called the inverse of z. In the following 
a spin configuration and its inverse are regarded as one 
single state. 

The study of ground-state landscapes helps to under- 
stand the nature of random systems ||]. But the cal- 
culation of the minima of H turns out to be a computa- 
tional hard problem: It is only for the special case of two- 
dimensional systems with periodic boundary conditions 
in no more than one direction and without external field 
that a polynomial-time algorithm is known for obtaining 
exact ground states Q . For more than two dimensions or 
in the presence of a magnetic field the problem belongs 
to the class of the NP-hard tasks 1^, i.e. only algorithms 
with exponentially increasing running time are available. 
The simplest method works by enumerating all 2^ possi- 
ble states and has obviously an exponential running time. 
Even a system size of 4^ is too large. The basic idea of 
the so called branch- and-hound algorithm Q is to exclude 
those parts of state space where no low-lying states can 
be found, so that the complete low-energy landscape of 
systems of size can be calculated 0. 

A more sophisticated method called branch- and- cut 
1^,^ works by rewriting the quadratic energy function: 
then a minimum of a linear function is to be found, but 
an additional set of inequalities must hold for all feasible 
solutions. Since not all inequalities are known a priori, 
the method iteratively solves the linear problem, looks 
for inequalities which are violated, and adds them to the 
set until the solution is found. Since the number of in- 
equalities grows exponentially with the system size the 
same holds for the computation time of the algorithm. 
Anyway, with branch-and-cut small systems up to 8'^ are 
feasible. 

The method utilized here is able to calculate true 
ground states jl^ up to sizes 14'^. For two-dimensional 
systems sizes up to 50^ can be treated. Additionally, 
in contrast to the methods mentioned earlier, the algo- 
rithm used here is able to calculate many statistically 
independent ground states for each realization of the ran- 
domness. The method is based on a special genetic al- 
gorithm 1^,^ and on the cluster-exact approximation 
(CEA) method jl^. This technique is explained briefly 
in the next section. 
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But it is not only the computer time needed for the 
calculation of one ground state which may increase ex- 
ponentially with the system size. For the ± J spin glass 
the number of ground states D, called the ground-state 
degeneracy, grows exponentially with N as well. This is 
due to the fact that there are always free spins, i.e. spins 
which can be turned over without changing the energy 
of the system. A state with / independent free spins al- 
lows for 2-^ different configurations all having the same 
energy. The quantity suitable to describe this behavior 
is the ground-state entropy 

So = kB {In D) (2) 

where (...) denotes the average over different realizations 
of the bonds. Since the number of free spins is extensive, 
the entropy per spin sq = Sq/N is non-zero for the ±J 
spin glass. 

As the ground-state degeneracy increases exponen- 
tially, it seems to be impossible to obtain all ground 
states for systems unless they are not very small. To over- 
come this problem in this work all clusters (also called 
funnels) of ground states are calculated. A cluster is 
defined in the following way: Two ground-state config- 
urations are called neighbors if they differ only by the 
orientation of one free spin. All ground states which are 
accessible through this neighbor relation are defined to 
be in the same cluster. 

The method presented here, called ballistic search 
(BS), is able to obtain all ground-state funnels without 
knowing all ground states. Additionally one can estimate 
the size of the funnels. Consequently, it is possible to 
calculate directly the ground-state entropy per spin even 
for systems exhibiting a huge T = degeneracy. Further- 
more, the number of funnels and their size-distribution 
as a function of system size are of interest on their own: 
for the infinite-ranged Sherrington-Kirkpatrik (SK) Ising 
spin glass a complex configuration-space structure was 
found using the replica-symmetry-breaking mean-field 
(MF) scheme by Parisi If the MF approximation 

is valid for finite-dimensional spin glasses as well, then 
the number of ground-state funnels must diverge with 
increasing system-size. On the other hand the droplet- 
scaling picture predicts that, basically, o ne g round-state 
funnel dominates the spin-glass behavior ||l5|-^19||. To ad- 
dress this issue a cluster-analysis was performed for small 
three-dimensional systems of one size L = 4 0. In ||2C| ] 
two-dimensional spin glasses of sizes up to 5 x 5 were in- 
vestigated. As a first application of BS, an analysis of the 
size dependence of the number of clusters for d — S (up 
to 8 X 8 X 8) is presented in , revealing an exponential 
increase as a function of the number of spins. 

The paper is organized as follows: First the procedures 
used in this work are presented in detail. Then the be- 
havior of the algorithms is tested with respect to different 
system sizes and parameters. It is shown that BS works 
reliable. In Section IV a variant of BS is presented, which 
allows to estimate the size of clusters, if only a small 



number of ground states are available per funnel. Next, 
as an application, the algorithm is utilized to investigate 
the ground-state cluster structure of two-dimensional ± J 
spin glasses. In particular, the dependence of the num- 
ber of clusters and the number of ground states on N are 
evaluated. The last section summarizes the results. 



II. ALGORITHMS 

First the CEA method is explained briefly. Then, for 
illustrating the the problem, a straight-forward method 
to identify clusters of ground states is given. In the main 
part the BS method for finding clusters in systems ex- 
hibiting a huge ground-state degeneracy is presented. 

The basic method used here for the calculation of spin- 
glass ground states is the cluster-exact approximation al- 
gorithm , which is a discrete optimization method de- 
signed especially for spin glasses. In combination with a 
genetic algorithm |lllJl^ this method is able to calculate 
true ground states |]lO||in three-dimensions for systems of 
sizes up to L = 14 on standard workstations. A detailed 
description of the method can be found in . Here the 
basic ideas of genetic CEA are summarized. 

The concept of frustration pl| ] is important for its un- 
derstanding. A system is called frustrated, if it is not 
possible to find a configuration, where all bonds con- 
tribute with negative values to the energy. One says it is 
not possible to satisfy all bonds. The CEA method con- 
structs iteratively and randomly a non-frustrated subset 
of spins within the system. Spins adjacent to many un- 
satisfied bonds are more likely to be added to the subset. 
During this construction a local gauge-transformation of 
the spin variables is applied so that all interactions be- 
tween subset spins become ferromagnetic p^ ] . The spins 
not belonging to the subset act like local magnetic fields 
on the subset spins. Therefore, the ground state of the 
subset is not trivial. Since the subset gives raise only to 
ferromagnetic interactions, an energetic minimum state 
for its spins can be calculated in poly nomial time by us- 
ing graph theoretical methods ||22|-p4| : an equivalent net- 
work is constructed [ p5| , the maximum fiow is calculated 
|p6| , p7| and the spins of the subset arc adjusted to their 
orientations leading to a minimum in energy regarding 
the subset. Therefore, the energy is decreased for the 
total system or remains the same. By iterating this pro- 
cess a few times the total energy of a system is decreased 
quite efficiently, but obtaining ground states turned out 
to be very hard. 

To increase the efficiency of CEA it is combined with 
a genetic algorithm ||T^. Genetic algorithms are biologi- 
cally motivated. An optimal solution is found by treating 
many instances of an optimization problem in parallel, 
keeping only better instances and replacing bad ones by 
new ones (survival of the fittest). With an appropriate 
choice of few simulation parameters, usually more than 
90% of all genetic CEA runs end up with a true ground 
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state. Configurations with a higher energy are not in- 
cluded in further calculations. 

Using this method one does not encounter ergodic- 
ity problems or critical slowing down like in algorithms 
which are based on Monte-Carlo methods. Moreover, 
it is possible to calculate many statistically indepen- 
dent configurations (replicas). Genetic CEA was al- 
ready utilized to examine the ground-state landscape of 
two-dimensional and three-dimensional ||2^ ±J spin 
glasses by calculating a small number of ground states 
per realization. Furthermore the existence of a spin- 
glass phase for nonzero temperature was confirmed for 
the three-dimensional spin glass |l^] . Finally, the method 
was applied to the ± J random-bond model to investigate 
its T = transition from ferromagnetism to spin-glass 
behavior 1 30 1 , which takes place by increasing the fraction 
of antiferromagnetic bonds starting from a ferromagnet. 

Once many ground states are calculated the straight- 
forward method to obtain the structure of the clusters 
works as follows: the construction starts with one arbi- 
trarily chosen ground state. All other states, which differ 
from this state by one free spin, are said to be its neigh- 
bors. They are added to the cluster. These neighbors are 
treated recursively in the same way: all their neighbors 
which are yet not included in the cluster are added. After 
the construction of one cluster is complete, the construc- 
tion of the next one starts with a ground state, which has 
not been visited so far. 

The running-time of the construction of the clusters 
is only a linear function of the degeneracy D {0{D)), 
similar to the Hoshen-Kopelman technique , because 
each ground state is visited only once. Unfortunately, the 
detection of all neighbors, which has to be performed at 
the beginning, is of 0{D^), because all pairs of states 
have to be compared. Since for L — b systems it is 
possible that they exhibit more than 10^ ground states, 
this algorithm is not suitable for larger sizes than L = 5 

The ballistic-search method instead is able to treat 
larger systems. Its basic idea is to use a test, which tells 
whether two ground states are in the same cluster or not. 
The test works as follows: Given two independent repli- 
cas {erf} and {erf} let A be the set of spins, which are 
different in both states: A = {i|crf ^ erf}. Now BS 
tries to build a path in configuration-space of successive 
fiips of free spins, which leads from {erf} to {erf}. The 
path consists of states which differ only by flips of free 
spins from A (see Fig. |^). For the simplest version iter- 
atively a free spin is selected randomly from A, flipped 
and removed from A. This test does not guaranty to 
find a path between two ground states which belong to 
the same cluster. It may depend on the order of selection 
of the spins whether a path is found or not, because not 
all free spins are independent of each other. Thus, a path 
is found with a certain probability , which depends on 
the size of A. Later on the behavior of pf is analyzed. 

The algorithm for the identification of clusters using 
BS works as follows: the basic idea is to let a ground state 



represent that part of a funnel which can be reached us- 
ing BS with a high probability by starting at this ground 
state. If a cluster is large it has to be represented by 
a collection of states, so that the whole cluster is "cov- 
ered" . For example a typical cluster of a L = 8 spin glass 
consisting of 10^^ ground states is usually represented by 
only some few ground states (e.g. two or three). A de- 
tailed analysis of how many representing ground states 
are needed as a function of cluster and system size can 
be found in the next section. At each time the algorithm 
stores a set of m clusters A = {A{r)\r = 1, . . . , m} each 
consisting of a set A{r) — {z*"'} of representing configu- 
rations z'"' — {cr['} (/ = 1, . . . , |A(r)|). At the beginning 
the cluster-set is empty. Iteratively all available ground 
states = {a-f} {j = 1,...,D) are treated: The BS 
algorithm tries to find paths from or its inverse to 
all representing configurations in A. Let F be the set 
of clusters-numbers, where a path is found. Now three 
cases are possible (see Fig. |]): 

• No path is found: F — ^ 

A new cluster is created, which is represented by 
the actual configuration treated: A{m+ 1) = {z^}. 
The cluster is added to A: A = AU {A{m + 1)}. 

• One or more paths are found to exactly one cluster: 
F — {/i}. Thus, the ground state z^ belongs to one 
cluster. Consequently, nothing special happens, the 
set A remains unchanged. 

• z^ is found to be in more than one cluster: F — 
{/i,...,/fe}. All these clusters are merged into 
one single cluster, which is now represented by the 
union A of the states, which have represented be- 
fore all clusters affected by the merge: 

A ^ U ■=! Mf,), A^{A}UA\ U ■.i{A(/,)} 

The whole loop is performed two times. The reason is 
that a state which links two parts of a large cluster (case 
3) may appear in the sequence of ground states before 
states appear belonging to the second part of the cluster. 
Consequently, this linking state is treated as being part 
of just one single smaller cluster and both subclusters are 
not recognized as one larger cluster (see Fig. ||). During 
the second iteration the "linking" state is compared to 
all other representing states found in the first iteration, 
i.e. the large cluster is identified correctly. With one iter- 
ation, the problem appears only, if few ground-states per 
cluster are available. Nevertheless, always two iterations 
are performed, so the difficulty does not occur. 

The BS-identification algorithm has the following ad- 
vantages: since each ground-state configuration repre- 
sents many ground states, the method does not need 
to compare all pairs of states. Each state is compared 
only with the representing configurations. For the sys- 
tem sizes usually encountered, this value is only slightly 
larger than the number of funnels itself. Thus, the com- 
puter time needed for the calculation grows only a little 
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bit faster than 0{Dnc), where nc is the number of clus- 
ters. Consequently, large sets of ground states, which 
appear already for small system sizes, can be treated. 
Furthermore, the ground-state funnel-structure of even 
larger systems can be analyzed, since it is sufficient that 
there are only a small number of ground states per cluster 
available. One has to ensure that really all clusters are 
found, which is simply done by calculating enough states. 
A study of how many states are needed for different sizes 
L is presented in the next section. 

III. NUMERICAL TESTS 

Since the BS cluster algorithm does not guaranty to 
find all clusters, numerical tests on two- and three- 
dimensional systems were performed. Here, the tests for 
three dimensions are presented, because for this type of 
system results are already available For two dimen- 
sions the algorithm behaves similar. Results concerning 
the number of ground states and the number of funnels 
for d = 2 are presented later on. 

For system sizes L — 3,4,5,6,8 large numbers of in- 
dependent ground states were calculated using genetic 
CEA. Usually 1000 different realizations of the disorder 
were considered. Tab. I shows the number of realiza- 
tions rifi and the number of independent runs r per re- 
alization for different system sizes L. For small systems 
sizes (and for 100 realizations of L = 5) many runs plus 
an additional local search were performed to calculate all 
existing ground states. For the larger sizes L — 5, 6, 8 
the number of ground states is too large, so it is only 
possible to try to calculate at least one ground state per 
cluster. We will see later that for most of the realizations 
it is highly probable that all existing clusters were found 
using genetic CEA. 

But first we concentrate on another issue: The ground 
states were grouped into clusters using the ballistic- 
search algorithm. To interpret the following results cor- 
rectly, one should keep in mind that for detecting one 
ground state being part of a cluster it is sufhcient to find 
just one path to any of the other states of the cluster. 
The question under consideration now is: how large is 
the probability, that for ground states belonging to the 
same cluster the BS test finds a path. 

To investigate this question the following test was per- 
formed: Many thousand times pairs of ground states were 
selected, which belong to the same cluster. The probabil- 
ity for selecting a pair was proportional to the size of the 
cluster (How to estimate the size of a cluster, if not all 
ground states are available, is shown in the next section). 
This guarantees that each ground state contributes to 
the result with its proper thermodynamical weight. The 
outcome of this test depends on the assumption, that the 
construction of the clusters has been performed correctly. 
Later we will see, that this has indeed been the case with 
a very high probability. Let pf he the probability that 



BS finds a direct path in configuration space connecting 
two given states. The result is expected to depend on the 
number of spins, which are different in both states, i.e. 
on the length /p^th of the path. The result is shown in 
Fig. ^ for system sizes L = 3,4,5,6,8. The probabihty 
decreases with increasing length of the path. Thus, find- 
ing a successful path becomes more difficult, which is to 
be expected, since the number of possible paths increases 
exponentially with Zp^th- C)n the other hand, by increas- 
ing the system size, it is more likely to find a connecting 
path. This is caused by the fact that the number of iso- 
lated free spins increases, which in fact can be flipped in 
any order. To investigate the dependence on L the fol- 
lowing finite-size behavior is assumed (A being a scaling 
exponent): 

Pfi^path^L) =pf{L-^l^g^^^) . (3) 

By plotting p/(/pg^^jj, L) against L^'^lp^th with correct 
parameter A the datapoints for different system sizes near 
^path ~ ^ should collapse onto a single curve. The best 
results were obtained for A = 1.7. In Fig. || the resulting 
scaling plot is shown. Now assume that two ground states 
differ by a certain fraction of spins. Thus, the absolute 
number of spins being different increases with L^. Since 
the length of a path for a fixed value of increases only 
with L^ '^, it becomes indeed more and more difficult to 
find a path with increasing system size L. 

So far the behavior of the ballistic search was in- 
vestigated. But what does it mean for the cluster- 
identification algorithm? We are interested in the ques- 
tion, whether all clusters are identified correctly. This 
can be formulated as a generalized percolation problem: 

• Consider 

— A set B = {z^, . . . , z^} of objects 

— A distance function d{z"', z^) 

— A probability Pbond('^)' ^^^^ ^ bond is cre- 
ated between two elements from i?. The prob- 
ability depends on the distance d between the 
elements and decreases monotonically with d. 

• The quantity of interest is the probability p\ that 
a/Z objects belong to the same cluster, i.e. the prob- 
ability that there is only one cluster. 

One can identify B with a set of ground states be- 
longing all to the same cluster, d{z'^,z^) with Zp^th ^^'^ 
Pbond('^) with the probability pf that a path is found. 
Then the quantity pi is the probability that all ground 
states are identified correctly by the BS clustering algo- 
rithm as being members of the same cluster. Since the 
average distance between different states decreases for a 
given cluster by increasing the number K of states, pi 
should increase with K. The reason is that more bonds 
are likely to be created (see Fig. It should be pos- 
sible to determine pi{K) for different functions d{z"-, z^) 
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and Pbond('^)' least numerically. But here a differ- 
ent approach is selected: Since all ground states and 
funnels are available, pi{K) can be evaluated directly. 
For each realization, each lattice size L and each number 
k £ [2, 20], a set oi K different ground states was selected 
50 times randomly from one cluster. Again each ground- 
state funnel was chosen with a weight proportional to its 
size. The BS clustering method was applied and it was 
verified whether just one cluster was found. The result 
is shown if Fig. 0. As the system size increases, larger 
clusters occur, which are harder to identify. But is visi- 
ble that even two ground states are sufficient most of the 
time to identify a cluster correctly. To be almost sure, 
a value of pi > 0.999 is expected to be sufhcient, which 
means that i^T = 10 is enough for L — 3 and, as found by 
further analysis, K = AO ior L = 8. 

In fact, for the largest ground-state funnels found in 
this work there are usually many more ground states 
available than needed for identifying a cluster correctly 
with a probability of 99.9%. Consequently, our results 
for the probability pf and pi are very reliable. Further- 
more, whenever the number of ground states is too small, 
it is always possible to generate additional states by per- 
forming T = Monte-Carlo simulations, i.e. selecting 
spins randomly and flipping them if they are free. Con- 
sequently, we can be sure that the funnels, which were 
used for the preceding analysis, were obtained correctly. 

Another question is, whether for a given realization 
there are some ground-state funnels, for which no ground 
states are found using just a restricted number of runs 
of genetic CEA. This problem does not occur for the 
smallest sizes, because it is possible to calculate all states 
of lowest energy using that method. But even for L — 6 
there are realizations already exhibiting more than 10^ 
ground states, making it impossible to obtain all of them 
directly. The genetic CEA method calculates a ground 
state with a probability pc, which increases on average 
with the size |C| of the cluster it belongs to Thus, 
ground states belonging to small funnels have a small 
probability pc of being found using a finite number of 
runs. This probability is not extremely small, since pc 
increases slower than the size of a cluster |C| [Q, i.e. for 
< IC2I 



PCl PC2_ 

\Cl\ \C2\ 
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but it is still small enough that some funnels may have 
been missed. Since pc increases with |C|, the probability 
that a cluster is not found at all takes the largest values 
for the smallest clusters, i.e. for a cluster of size 1. This 
probability is denoted here with pi. Consequently, Pi is 
an upper limit for the probability that a certain cluster 
is missed. Now pi is estimated. 

Consider a list of K ground states z^, . . . {z^ — 
{cr^}), in the order they were obtained in the calcula- 
tion using genetic CEA. Thus, on average states from 
larger funnels appear earlier in the list than states from 



smaller funnels. A state which is calculated several times, 
is stored in the list just once. For each state the number 
of times hj it has occurred is recorded, let h = J^j hj ■ 
For small systems, where the number of existing ground 
states is small compared to the number of runs, usu- 
ally hj > 1. Now wc look at the smallest cluster Cmin, 
which was found using the procedure. The relative fre- 
quency, that a ground state from Cmin is found, is ap- 
proximately Pmin — Sjec hj/h. It follows from (Q) 
that pi > Pmin/|C'inin|- Thus, WC havc for the probability 
Pi that a cluster of size 1 is not found during h different 
runs 



Pn 



(5) 



Consequently, it is possible to estimate for each sin- 
gle configuration the likelihood that a small cluster may 
have been missed. For the smaller sizes, where it was 
claimed that all ground states were found using a large 
number of runs, typical values p^ < 10^^° were found. 
A small cluster was missed with p^ > 0.01 only for three 
realizations of L = 3 and never for L = 4, 5. Thus, it 
is highly probable, that all ground states were found for 
the smaller sizes L = 3, 4, 5 

For larger sizes, the number of states obtained per clus- 
ter is small compared to the size of the cluster. The 
estimate (||) gives always a large value. Consequently, 
another method of estimating the quality of the results 
has to be applied: the progression of the BS cluster al- 
gorithm is observed during the processing of the ground 
states 2^, . . . , z^ . Each state which causes a new cluster 
to be created or some clusters to be merged is called an 
event. Since there is only a finite number nc of clusters 
and each cluster is represented by a finite number of con- 
figurations there is only a finite number of events. For the 
systems sizes encountered here, the number of events is 
only slightly larger than nc, because most of the clusters 
are represented by just one ground state. In principle, 
if the last event is known, no further ground states have 
to be processed. Since the last event is not known for 
system sizes L > 5, one can only assume that the last 
event has already occurred, if no new event is found for 
a long time, while treating more and more states z^ . At 
each step let 



Qij) ^ 



number of the last event before z^ 



(6) 



The fraction Q measures the relative length of se- 
quences, where no event occurs. For j beyond the last 
event, Q{j) —>■ 00. The longest sequence found before 
the last event Q = max^^jg^g-j- Q{j), describes how many 
states are needed to find all clusters without knowing the 
last event. 

Using the number of runs of the genetic CEA algo- 
rithms given above, a value of Q larger than 4 was never 
observed for L = 3. This means, one can be sure that 
all funnels have been identified, if the number of ground 
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states processed is four times larger than the number 
of the state constituting the last event. For L = 4 the 
largest Q found was 3 and for L = 5 it was observed 
that Q < 2.5 for all realizations. For larger sizes Q is not 
known, so Q{K) is used instead. Assume that the last 
event has already occurred, then by including more and 
more states into the analysis, Q{K) grows linearly and 
the confidence increases that really no further event is to 
be expected. We believe that if the number K of ground 
states is more than four times the number of the last 
event in z^, . . . , z^, i.e. Q{K) > 4 one can be quite sure 
that all funnels have been found, because Q < 4 for all 
small sizes. Even if Q{K) = 2, it seems very likely that 
no cluster has been missed, since Q seems to decrease by 
going to larger sizes. For L = 5, 6 Q{K) < 4 was found 
for only about 8% of the realizations, and Q{K) < 2 only 
for 2% (L — 5) respectively 5% {L — 6). Consequently, 
nearly all clusters have been identified. Q > 4 holds for 
75 % of all L = 8 realizations {Q > 2 for 85%), i.e. here a 
small number of funnels may have been missed for 25% of 
all realizations, while for the majority of the realizations 
really all funnels have been detected. Only by increasing 
massively the number of available ground states per re- 
alization, a substantial improvement for the largest size 
treated in this work is possible. 

On the other hand, if physical properties have to be 
evaluated, the results are very reliable even for Q{K) « 2, 
because each cluster contributes with a weight propor- 
tional to its size. As mentioned before, the probability 
that genetic CEA returns a certain ground state increases 
with cluster size. Consequently, only small clusters are 
omitted and the result is affected only slightly. 

IV. SIZE OF A CLUSTER 

Once all clusters are identified their sizes have to be 
obtained to calculate the entropy. A variant of BS is used 
to perform this task. Starting from a state {ui} from 
a cluster C, free spins are flipped iteratively, but each 
spin not more than once. During the iteration additional 
free spins may be generated and other spins may become 
fixed. When there are no more free spins left the process 
stops. Thus, one has constructed a straight path in state 
space from the ground state to the border of the funnel C. 
The number of spins that has been flipped is denoted by 
^max- By averaging over several trials and several ground 
states of a cluster, one obtains an average value Imax, 
which is a measure for the size of the cluster. 

For system sizes L = 3, 4, 5 all ground states were avail- 
able (for 100 realizations for L = 5) and the cluster sizes 
are known exactly. Fig. js] displays the average size V 
of a cluster as a function of ^max- An exponential de- 
pendence is found, yielding V = 2"'"'"= with a — 0.90(5). 
The deviation from the pure exponential behavior for the 
largest clusters of each system size should be a finite size 
effect. 



One might think that instead of successively turning 
spins over, one could simply count the static number of 
free spins. But it turns out that the quantity /,„ax de- 
scribes the size of a cluster better. The reason is that 
by flipping spins additional free spins are created and 
deleted. Consider for example a one-dimensional chain of 
N ferromagnetic coupled spins with antiperiodic bound- 
ary conditions. Each ground state consists of two linear 
domains of spins. In each domain all spins have the same 
orientation. For each ground-state there are just two free 
spin, but all 2A^ ground states belong to the same clus- 
ter. The possibility of similar ground-state topologies is 
taken into account using the definition given above. 

V. RESULTS 

The data presented in the preceding sections show that 
earlier results |^ for three-dimensional spin glasses are re- 
liable, where an exponential increase of the degeneracy 
and the number of ground-state funnels was found. In 
this section a similar analysis of the ground-state land- 
scape of two-dimensional systems is performed. It will 
be shown that qualitatively the behavior is the same as 
for d = 3. 

For system sizes L = 5,7, 10, 14, 20 large numbers of 
independent ground states were calculated using genetic 
CEA, up to 10** runs per realization were performed. 
Since many runs are needed to describe the ground-state 
landscape as completely as possible, no runs for larger 
systems were conducted, although it is possible to obtain 
true ground states easily up to L = 50. Usually 1000 
different realizations of the disorder were considered, ex- 
cept for L ~ 20, where only 92 realizations could be 
treated. For the small systems sizes L = 5,7 many runs 
plus an additional local search were performed to calcu- 
late all ground states. For the larger sizes L = 10, 14, 20 
the number of ground states is too large, so we restrict 
ourselves to calculate at least one ground state per clus- 
ter. The probability that some clusters were missed is 
higher for two dimensions than for the c? = 3 case, be- 
cause the ground-state degeneracy grows faster with the 
system size: for small systems sizes L < 10 it is again 
highly probable that all funnels have been obtained. For 
L = 14 some small funnels may have been missed for 
about 30% of all realizations, while for L = 20 this frac- 
tion raises even to 60%. This is due to the enormous 
computational effort needed for the largest systems. For 
the L = 20 realizations a total computing time of more 
than 2 CPU-years was consumed on a cluster of Power- 
PC processors running with 80MHz. 

The ground states were grouped into clusters using the 
ballistic-search algorithm. The number of states per fun- 
nel was sufficiently large, so that only with a probability 
of less than 10"'^ some configurations from a large clus- 
ter may be mistaken for belonging to different funnels. In 
Fig. ^ the average number nc of clusters is shown as a 
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function of the number N of spins. By visuaUzing the re- 
sults in a double-logarithmic plot (see inset) one realizes 
that nc seems to grow faster than any power of N. The 
larger slope in the linear-logarithmic plot for small sys- 
tems may be a finite-size effect. Additionally for L — 20 
there is a large probability that some small funnels are 
missed, explaining the smaller slope there. Consequently, 
the data presented here favor an exponential increase of 
nc(iV). 

For the small systems sizes the number of ground states 
in each cluster could be counted directly. For the larger 
sizes the variant of the BS method was used to estimate 
the size of each cluster. The average size of a cluster 
as a function of Imax is displayed in Fig. Similar to 
the results presented in the preceding section, an expo- 
nential dependence is found, yielding V = 2"'"="= with 
a = 0.85(5). 

By summing up all cluster sizes for each realization the 
ground-state degeneracy D is obtained. The quantity 
averaged over all realizations is shown in Fig. ll] as a 
function of A'^. The exponential growth is obvious. 

The result for the average ground-state entropy per 
spin is shown in the inset of Fig. |ll|. By fitting a function 
of the form so{L) = so{oo) + a* a value of so(oo) = 
0.0856(4)fcB is obtained. 

In So « 0.075fcs was estimated by using a recur- 
sive method to obtain numerically exact free energies up 
to L = 18. For technical reasons, only systems with pe- 
riodic boundary conditions in one direction were treated, 
which may be the reason for the smaller result. The re- 
sult of So w O.OTfcs found in Q is even shghtly lower. 
The value found by a Monte-Carlo simulation so ~ O.lfcs 
p5[ for systems of size 80^ is much larger. The deviation 
is presumably caused by the fact that it was not possible 
to obtain true ground states for systems of that size, i.e. 
too many states were visited. The entropy is consider- 
able higher than for the three-dimensional ± J spin glass, 
where so(oo) ~ 0.051(l)fcs was obtained using the same 
method applied here [||. 

The result for the entropy does not suffer from the fact, 
that some ground-state funnels may have been missed 
for L = 14, 20: the probability for finding a cluster by 
applying genetic CEA grows with the size of the cluster 
p2[ . This implies that the clusters which may have been 
missed are considerably small, so the influence on the 
result is negligible. The largest source of uncertainty is 
caused by the assumption that the size of a cluster grows 
like 2"'°"*='. The error of the constant a enters linearly 
into the result of the entropy. To estimate the influence 
of this approximation, So was calculated using estimated 
cluster sizes as well for the three smallest systems sizes, 
where the entropy had been obtained exactly. For both 
cases the results were equal to the exact values within 
error bars. The final result quoted here is so = 0.086(4). 



VI. CONCLUSION 

The ballistic-search method has been presented, which 
allows the fast identification of very large clusters, ap- 
pearing for example in the calculation of the ground-state 
landscape of ± J spin glasses. Furthermore, it is possible 
to calculate clusters of systems when only a small frac- 
tion of all their states is available. The method should be 
extendable to similar clustering problems, especially for 
analyzing results from simulations at finite temperature. 
A variant of the technique is used to estimate the size of 
the clusters. 

Since the BS algorithm does not guarantee to find a 
path in configuration space between two ground states 
which belong to the same cluster, extensive numerical 
tests were performed. It was shown that by increasing 
the number of available states, it is possible to reduce 
the probability that a cluster is not identified correctly. 
Additionally it is possible to estimate the probability that 
small clusters are not found. Consequently, the new tech- 
nique enables to analyze the complete funnel structure 
for two-dimensional ±J spin glasses up to L = 20 and 
for three-dimensional systems up to L = 8. Thus, sys- 
tems exhibiting up to 10^^ ground states can be treated 
efficiently. 

For d = 2 an analysis of the ground-state landscape has 
been presented. The number of funnels and the ground 
state degeneracy increases exponentially with the system 
size. The ground-state entropy per spin was found to be 
So — 0.086(4)fcB. Results for three dimensional systems 
can be found in [||. It should be pointed out that the 
result for the entropy does not depend on the way a clus- 
ter is defined. The specific definition given here is only a 
tool which allows the treatment of systems exhibiting a 
huge ground-state degeneracy. 
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FIG. 1. Ballistic search: A path in configuration-space of 
free spins is constructed between two ground states (dark 
nodes) belonging to the same cluster. Depending on the order 
the spins are flipped the path may be found or not. Nodes rep- 
resent ground states, edges represent flips of free spins. Please 
note that this figure is only a cartoon, the configuration space 
has N dimensions. 



before iteration j 



BS-test: to how many valleys does tine state belong ? 
a) no valley 



b) one valley 



c) several valleys 



FIG. 2. Algorithm for the identification of all clusters: sev- 
eral ground-states (circles) "cover" parts of clusters (filled ar- 
eas). During the processing of all states a set of clusters is 
kept. When state z-' is treated, it is tested using BS to how 
many of the already existing clusters the state belongs. Three 
cases can occur: a) The ground state is found to belong to no 
cluster, b) it is found in exactly one cluster and c) it is found 
in several clusters. In the first case a new cluster is found, in 
the second one nothing changes and in the third case several 
smaller clusters are identified as subsets of the same larger 
cluster. 
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FIG. 3. Example, that the order the states are treated may 



affect the result. Consider three states , 



all belonging 



to the same cluster. Assume that BS finds a path between 
(z^, 2^) and (2^, 2^), but not between (2^, 2"^). In the first case 
two clusters are found (false), in the second case one cluster 
(correct). To obtain always the correct result, two iterations 
are needed. 




FIG. 4. Probability that BS finds a path of free flipping 
spins between two ground states belonging to the same funnel 
of three-dimensional ±J spin glasses, p/ is shown as a func- 
tion of the number 'p^^jj of spins, which are different in the 
two states for lattice sizes L = 3, 4, 5, 6, 8. 



FIG. 5. Finite-size scaling plot of p/(L, Zp^^^j^) (see Fig. 
A scaling behavior of pf{L, Ipg^i}^) = P(-f'~^'path) ^'^ assumed. 
Using A = 1.7 the data points for L = 4, 5, 6, 8 fall onto one 
curve near the origin 'pa_th ~ 0. 




FIG. 6. By increasing the number of available states per 
cluster, the probability increases that they are identified as 
members of the same cluster. Circles denote states, the thick- 
ness of the line represents the probability that a path is found 
by the ballistic search. 
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FIG. 7. Probability pi that a sample of K ground states 
belonging to the same cluster is indeed identified by the BS 
clustering algorithm as one single cluster as a function of K 
for different system sizes L (d — 3). 
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FIG. 8. Average size V of a cluster as a function of 
average dynamic number /max of free spins (see text) for 
three-dimensional ± J spin glasses of system sizes L = 3, 4, 5, 
where all ground have been obtained. KV = 2'''^'™'"' depen- 
dence is found, indicated by a line. 
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FIG. 9. Number nc of ground-state clusters for 
two-dimensional ±J spin glasses as a function of system size 
A'^. The inset shows the same data using a double-logarithmic 
scale. Lines are guide to the eyes only. 
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FIG. 10. Average size V oi a. cluster as a function of 
average dynamic number /max of free spins (see text) for 
two-dimensional ± J spin glasses of system sizes L — 5,7, 
where all ground have been obtained. A V — 2'''*^''"^^ depen- 
dence is found, indicated by a line. 
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FIG. 11. Number D of ground-states for two-dimensional 
±J spin glasses as a function of system size N. The num- 
ber of states grows exponentially with the number of spins. 
Lines are guide to the eyes only. The inset displays the 
ground-state entropy per spin as a function of L. The line 
shows a fit extrapolating so to the infinite system which yields 
so(oo) = 0.0856(4)fes. 



L n_R r 

3 1000 1000 

4 1000 10* 

5 100 10^ 

5 1000 3000 

6 1000 5000 
8 192 2 X 10* 



TABLE I. Three-dimensional ±J spin glasses. For each 
system size L: number riR of realizations, number r of inde- 
pendent runs per realization. 
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